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(57) The broadcast-transmitting server in accord- 
ance with the present invention includes a separator for 
separating one or a plurality of broadcast provided 
through broadcast-distribution service, into broadcast 
images and broadcast data, a data transmitter for trans- 
mitting the broadcast data separated from the broadcast 
by the separator, to a mobile terminal, and a distributor 
which receives a request indicative of desired broadcast 
image determined based on the broadcast data, from 
the mobile terminal, and distributes the desired broad- 
cast image among broadcast images separated from 
the broadcast by the separator, to the mobile terminal 
which transmitted the request to the distributor. The 
broadcast-transmitting server in accordance with the 
present invention makes it possible even for a user who 
does not have an apparatus for receiving television 
broadcast, at his or her home to receive broadcast dis- 
tribution service from a television broadcast transmitting 
server through his or her mobile terminal, and hence, 
be able to looking at television programs, while he or 
she is out of his or her home. 



FIG.1 



, TELEVISION BROADCAST 
100 TRANSMITTING SERVER 



101 



H 



102 



105 




tWAGL/SCUND— FORM 



105 DISTRIBUTOR 

jL 




NW COMMUNICATION NETWORK 



MOBILE TERMINAL 
200 



201 
*L — 



BROADCAST 
- DATA 




(DISPLAY 1 
uwrr \ 



205 



20T 



SOUND 
OUTPUT 

_PEVIC6 _ 



Q. 
LU 



Printed by Jouve, 75001 PARIS (FR) 



BNSOOCID: <EP 1343322A1_I_> 



EP 1 343 322 A1 



Description 

BACKGROUND OF THE INVENTION 

[0001 ] The invention relates to a method of looking at 5 
and listening to broadcast for looking at television broad- 
cast program through a mobile terminal, and further to 
a broadcast-transmitting server, a mobile terminal and 
a control apparatus . : cr looking at and listening to broad- 
cast and making communication in multi-point all of 
which are suitable for a system for looking at and listen- 
ing to television programs through a mobile terminal. 

PRIOR ART 

[0002] With digitalization of television broadcast, tel- 
evision programs are transmitted through a plurality of 
channels. In addition, unlike conventional television 
broadcast service in which only images and sound are 
distributed, there is suggested new service which pro- 
vides television programs to which digital data is multi- 
plexed. 

[0003] In the specification, such multiplexed digital 
data is called broadcast data in order to distinguish from 
communication image and sound. Broadcast data in- 
cludes electronic program guide (EPG) and program- 
related data. Herein, program-related data means an in- 
teractive program in which a television viewer can par- 
ticipate, or data indicative of present scores in sport 
games. 

[0004] In order for a user to look at and listen to a de- 
sired television program in multi-channeled television 
broadcast while he or she is free, he or she may bring 
a portable television set with him or her. However, such 
a portable television set has to include all parts neces- 
sary for receiving television programs, such as a tuner, 
and as a result, is unavoidably large in a size and ex- 
pensive. Thus, there have been suggested many sys- 
tems to make it possible to look at and listen to television 
programs through the use of a mobile terminal not in- 
cluding parts necessary for receiving television pro- 
grams, such as a tuner. 

[0005] For instance, Japanese Patent Application 
Publication No. 11-136658 has suggested a combina- 
tion of an interactive television set and a mobile terminal 
in which an interactive television program received at a 
television set located at a user's home is transferred to 
a user's mobile terminal through a public line network 
for a user to be able to look at and listen to the interactive 
television program even while a user is out of his or her 
home. 

[0006] Japanese Patent Application Publication No. 
11-346166 has suggested a portable system including 
a principal apparatus located at a user's home and a 
mobile terminal. In order to efficiently download televi- 
sion programs having been received and stored in the 
principal apparatus, to the mobile terminal, a smaller 
amount of data among data, sound and images consti- 
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tuting a television program is downloaded more early to 
the mobile terminal, resulting in that a whole of a televi- 
sion program can be downloaded to a mobile terminal 
in a short period of time. 

[0007] Japanese Patent Application Publication No. 
2000-183836 has suggested a data-transmission sys- 
tem including a receiver located at a user's home and a 
mobile terminal. The receiver is designed to be remote- 
controllable by the mobile terminal and the receiver is 
designed to transmit various data received from digital 
satellite broadcast, to the mobile terminal through a 
communication network in order to make it possible for 
a user to obtain data transmitted from digital satellite 
broadcast even while a user is out of his or her home. 
As data to be transmitted to the mobile terminal, there 
are listed image and sound signals as well as broadcast 
data such as EPG. The image and sound signals are 
transmitted to the mobile terminal without any modifica- 
tion to the received image and sound signals. 
[0008] Japanese Patent Application Publication No. 
2000-295588 has suggested an apparatus for receiving 
a digital data program. Even if a user is located away 
from a television set, the user can automatically receive 
necessary data among data signals multiplexed to the 
program, through a telephone line network. In the sug- 
gested apparatus, data signals extracted from television 
broadcast signals are temporarily stored in a memory, 
and a central processing unit (CPU) checks whether the 
data signals are grouped into a predetermined genre or 
whether the data signals include a predetermined key- 
word. If a predetermined item is found in retrieval in the 
data signals, the data signals are stored in a memory. 
Thereafter, if a telephone number of a target person is 
stored in a user's cellular phone, a call is automatically 
made to the target person. When it is confirmed that a 
line between the user and the target person has been 
established, it is checked which form data to be trans- 
mitted has. If data has a form of "sound", the data signals 
stored in the memory are converted into sound data, and 
then, transmitted through a modem. 
[0009] With a recent increase in radio-signal commu- 
nication speed, there has been suggested a mobile ter- 
minal in the form of a television telephone which terminal 
enables a user to look at image clips such as advertise- 
ment of movies or promotion films of music artists, and 
to have a chat seeing images of a person with which the 
user is making communication now. 
[0010] As mentioned above, there have been sug- 
gested a variety of systems for looking at and listening 
to television programs through the use of a mobile ter- 
minal. However, in all of such conventional systems as 
mentioned above, it was unavoidable for a user to set 
his or her television set at a base such as his or her 
home as a principal apparatus for receiving television 
programs. Accordingly, the conventional systems were 
accompanied with a problem that a user who does not 
have a television set at a base such as his or her home 
cannot look at and listen to television programs while he 
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or she is out of his or her home. 
[0011] The conventional mobile terminals were ac- 
companied with a problem that a user cannot look at 
and listen to television programs while he or she is mak- 
ing communication with others through the mobile ter- 5 
minal, and that a user and a person with whom the user 
is making communication cannot commonly look at tel- 
evision programs while they are having a chat. 

DISCLOSURE OF THE INVENTION 10 

[0012] In view of the above-mentioned problems in 
the prior art, it is an object of the present invention to 
enable a user to be able to look at and listen to television 
programs through a mobile terminal while he or she is is 
out of his or her home, even if he or she does not set a 
particular equipment for receiving television programs 
at a base such as his or her home. 
[0013] Another object of the present invention istoen- 
able a user to be able to look at and listen to television 20 
programs while he or she is having a chat with his or her 
friend through their mobile terminals, and to join conver- 
sation or conference with images of television programs 
being commonly owned with other participants. 
[0014] In the first aspect of the present invention, 
there is provided a broadcast-transmitting server includ- 
ing a separator for separating one or a plurality of broad- 
cast provided through broadcast-distribution service, in- 
to broadcast images and broadcast data, a data trans- 
mitter for transmitting the broadcast data separated 
from the broadcast by the separator, to a mobile termi- 
nal, and a distributor which receives a request indicative 
of desired broadcast image determined based on the 
broadcast data, from the mobile terminal, and distrib- 
utes the desired broadcast image among broadcast im- 
ages separated from the broadcast by the separator, to 
the mobile terminal which transmitted the request to the 
distributor. 

[001 5] For instance, the distributor may be comprised 
of one or a plurality of transmitters) which transmit(s) 
the desired broadcast image requested by the mobile 
terminal based on the broadcast data, to the mobile ter- 
minal which transmitted the request, and a multi-caster 
which provides the broadcast image requested by the 
transmitter among broadcast images separated from 
the broadcast by the separator, to the transmitter which 
requested to receive the broadcast image. 
[0016] The multi-caster may be designed to distribute 
the broadcast image separated from the broadcast by 
the separator, in a multi-casting way, and the transmitter 
(s) may be designed to select broadcast image or broad- 
cast images among the broadcast images distributed 
from the multi-caster, in accordance with the request 
transmitted from the mobile terminal. 
[0017] The distributor may be designed to monitor 
whether the transmitter is in operation or not, and as- 
signs a transmitter not in operation to the mobile termi- 
nal on receipt of the request from the mobile terminal. 



[0018] It is preferable that the broadcast-transmitting 
server further includes a data-form converter which con- 
verts a form of the broadcast data separated from the 
broadcast by the separator, into a form suitable forbeing 
displayed in the mobile terminal. 
[0019] It is preferable that the broadcast-transmitting 
server may further include a converter which converts 
a form of the broadcast image separated from the broad- 
cast by the separator, into a form suitable for being dis- 
played or reproduced in the mobile terminal. 
[0020] In the second aspect of the present invention, 
there is provided a broadcast-transmitting server includ- 
ing a separator for separating one or a plurality of broad- 
cast provided through broadcast-distribution service, in- 
to broadcast images and broadcast data, a data-trans- 
mitter which transmits the broadcast data separated 
from the broadcast by the separator, to a control appa- 
ratus for looking at and listening to broadcast and mak- 
ing communication in multi-point which apparatus re- 
ceives image and sound from one or a plurality of mobile 
terminals), and synthesizes image and sound, respec- 
tively, for producing communication image and commu- 
nication sound, and a distributor receives a request of 
transmission of desired broadcast image through the 
control apparatus which request is determined in the 
mobile terminal in accordance with the broadcast data 
transmitted through the control apparatus, and trans- 
mits the requested desired broadcast image among the 
broadcast images separated from the broadcast by the 
separator, into the control apparatus which transmitted 
the request. 

[0021] The distributor may be designed to be com- 
prised of one or a plurality of transmitter(s) which re- 
ceive(s) the request of transmission of desired broad- 
cast image through the control apparatus, and transmit 
(s) the requested desired broadcast image to the mobile 
terminal which transmitted the request, through the con- 
trol apparatus, and a multi-caster which distributes 
broadcast image requested by the transmitter(s) among 
the broadcast images separated from the broadcast by 
the separator, to thetransmitter(s) which transmitted the 
request. 

[0022] For instance, the multi-caster may be designed 
to distribute the broadcast image separated from the 
broadcast by the separator, in a multi-casting way, and 
the transmitters) selects broadcast image or broadcast 
images among the broadcast images distributed from 
the multi-caster, in accordance with the request trans- 
mitted from the mobile terminal through the control ap- 
paratus. 

[0023] It is preferable that the broadcast-transmitting 
serverfurther includes a data-form converter which con- 
verts a form of the broadcast data separated from the 
broadcast by the separator, into a form suitable for being 
displayed in the mobile terminal making communication 
with the control apparatus. 

[0024] It is preferable that the broadcast-transmitting 
server further includes a converter which converts a 
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form of the broadcast image separated from the broad- 
cast by the separator, into a form suitable for being dis- 
played or reproduced in the mobile terminal making 
communication with the control apparatus. 
[0025] In the third aspect of the present invention, 
there is provided a control apparatus for looking at and 
listening to broadcast and making communication in 
multi-point, including a request receiver which receives 
requests from mobile terminals, a image/sound receiver 
which receives image and sound transmitted from the 
mobile terminals, a broadcast-data receiver which re- 
ceives, from a broadcast-transmitting server which sep- 
arates one or a plurality of broadcast provided through 
broadcast-distribution service, into broadcast images 
and broadcast data, and distributes the broadcast im- 
ages and the broadcast data, the broadcast data in ac- 
cordance with a request transmitted from the mobile ter- 
minal, a receiver which receives a request of transmis- 
sion of desired broadcast image determined by the mo- 
bile terminal in accordance with the broadcast data, 
transmits the request to the broadcast-transmitting serv- 
er, and receives the desired broadcast image from the 
broadcast-transmitting server an image/sound synthe- 
sizer which synthesizes image and sound received by 
the image/sound receiver for producing communication 
image and communication sound, and, on receipt of a 
request from the request receiver, synthesizes the 
broadcast data received by the broadcast-data receiver 
or the broadcast image received by the receiver and the 
communication image and sound with each other, and 
a multi-point image/sound transmitter which transmits 
the communication image and sound having been syn- 
thesized with the broadcast data or the broadcast image 
in the image/sound receiver, to the mobile terminal. 
[0026] It is preferable that the control apparatus fur- 
ther includes a broadcast-data transmitter which trans- 
mits the broadcast data received by the broadcast-data 
receiver, to the mobile terminal transmitting the request, 
and an image/sound transmitter which transmits the 
broadcast image received by the receiver, to the mobile 
terminal transmitting the request. 
[0027] It is preferable that the broadcast data is trans- 
mitted as packets through packet-switching network or 
internet network of public line, and the broadcast image, 
the communication image and the communication 
sound are transmitted through line-switching network. 
[0028] In the fourth aspect of the present invention, 
there is provided a mobile terminal including a broad- 
cast-data receiver which receives, from a broadcast- 
transmitting server which separates one or a plurality of 
broadcast provided through broadcast- distribution serv- 
ice, into broadcast images and broadcast data, and dis- 
tributes the broadcast images and the broadcast data, 
the broadcast data, a receiver which transmits a request 
of transmission of desired broadcast image determined 
in accordance with the broadcast data, to the broadcast- 
ing-transmitting server, and receives the desired broad- 
cast image from the broadcast-transmitting server, and 
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a display controller which displays the broadcast data 
received by the broadcast-data receiver or the broad- 
cast image received by the receiver. 
[0029] It is preferable that the display controller con- 
5 currently displays the broadcast data received by the 
broadcast-data receiver and the broadcast image re- 
ceived by the receiver. 

[0030] It is preferable that the receiver receives 
broadcast sound, and further including a reproduction 

10 controller which outputs received broadcast sound. 
[0031] It is preferable that the broadcast-data receiver 
successively transmits a request of transmission of the 
broadcast data to the broadcast-transmitting server, and 
successively receives the broadcast data from the 

is broadcast-transmitting server, and the display controller 
successively displays the broadcast data received by 
the broadcast-data receiver. 

[0032] It is preferable that the mobile terminal works 
as a cellular phone. 

20 [0033] It is preferable that the mobile terminal has a 
function of a cellular phone which makes communica- 
tion with other phones through sound and image, the 
display. controller displays image of a parson with which 
the mobile terminal makes communication, or the 

25 broadcast image, and the reproduction controller out- 
puts voice of a person with which the mobile terminal 
makes communication, or the broadcast sound. 
[0034] In the fifth aspect of the present invention, 
there is provided a mobile terminal including a commu- 

30 nicator which receives, from a control apparatus for 
looking at and listening to broadcast and making com- 
munication in multi-point which apparatus receives im- 
ages and sound from one or a plurality of mobile terminal 
(s), and synthesizes the images and the sound with one 

35 another, respectively, to thereby produce communica- 
tion image and communication sound, the communica- 
tion image and the communication sound, a broadcast- 
data receiver which transmits a request of transmission 
of broadcast data to the control apparatus, causes the 

40 control apparatus to receive the requested broadcast 
data from a broadcast-transmitting server which sepa- 
rates one or a plurality of broadcast provided through 
broadcast-distribution service, into broadcast images 
and broadcast data, and distributes the broadcast im- 

45 ages and the broadcast data, and receives the request- 
ed broadcast data from the control apparatus, and a re- 
ceiver which transmits a request of transmission of de- 
sired broadcast image determined in accordance with 
the broadcast data received by the broadcast-data re- 

so ceiver, to the control apparatus, and receives the de- 
sired broadcast image from the broadcast-transmitting 
server. 

[0035] It is preferable that the broadcast-data receiver 
transmits a request of synthesizing the broadcast data 
55 to the communication image to the control apparatus, 
and causes the control apparatus to synthesize the 
broadcast data and the communication image to each 
other and transmit the communication sound and the 
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communication image to which the broadcast data has 
been synthesized, and the communicator receives the 
communication sound and the communication image to 
which the broadcast data has been synthesized, from 
the control apparatus. 5 
[0036] It is preferable that the receiver transmits a re- 
quest of synthesizing the broadcast image to the com- 
munication image to the control apparatus, and causes 
the control apparatus to synthesize the broadcast image 
and the communication image to each other and trans- 10 
mit the communication sound and the communication 
image to which the broadcast image has been synthe- 
sized, and the communicator receives the communica- 
tion sound and the communication image to which the 
broadcast image has been synthesized: from the control 1$ 
apparatus. 

[0037] It is preferable that the receiver receives 
broadcast sound, and that the mobile terminal further 
includes a display controller which displays at least one 
of the broadcast data received by the broadcast-data 
receiver, the broadcast image received by the receiver, 
and the communication image received by the commu- 
nicator, and a reproduction controller which outputs the 
communication sound received by the receiver or the 
communication sound received by the communicator. 
[0038] It is preferable that the display controller con- 
currently displays the broadcast data received by the 
broadcast-data receiver and the communication image 
received by the communicator in a display unit. 
[0039] In the sixth aspect of the present invention, 
there is provided a method of looking at and listening to 
broadcast between a broadcast-transmitting server and 
a plurality of mobile terminals connected to the broad- 
cast-transmitting server through a communication net- 
work, including the broadcast-transmitting server sepa- 
rating one or a plurality of broadcast provided through 
broadcast-distribution service, into broadcast image 
and broadcast data, and transmitting the broadcast data 
to the mobile terminal, the mobile terminal receiving the 
broadcast data, and transmitting a request of transmis- 
sion of the broadcast image to the broadcast-transmit- 
ting server in accordance with the broadcast data, and 
the broadcast-transmitting server receiving the request 
from the mobile terminal, and transmitting the requested 
broadcast image to the mobile terminal. 
[0040] In the seventh aspect of the present invention, 
there is provided a method of looking at and listening to 
broadcast between a broadcast-transmitting server and 
a plurality of mobile terminals connected, to the broad- 
cast-transmitting server through a communication net- 
work, including the mobile terminal transmitting a re- 
quest of transmission of broadcast data to the broad- 
cast-transmitting server, the broadcast-transmitting 
server receiving the request transmitted from the mobile 
terminal, separating one or a plurality of broadcast pro- 
vided through broadcast-distribution service, into broad- 
cast image and broadcast data, and transmitting the 
broadcast data to the mobile terminal which transmitted 



the request, the mobile terminal receiving the broadcast 
data, and transmitting a request of transmission of the 
broadcast image to the broadcast-transmitting server in 
accordance with the broadcast data, and the broadcast- 
transmitting server receiving the request from the mo- 
bile terminal, and transmitting the requested broadcast 
image to the mobile terminal. 

[0041] In the eighth aspect of the present invention, 
there is provided a .method of looking at and listening to 
broadcast among a broadcast-transmitting server, a plu- 
rality of mobile terminals, and a control apparatus for 
looking at and listening to broadcast and making com- 
munication in multi-point which apparatus is connected 
to the broadcast-transmitting server and the mobile ter- 
minals through a communication network, including the 
control apparatus receiving images and sound from one 
or a plurality of mobile terminal(s), synthesizing the im- 
ages and the sound with one another, respectively, to 
thereby produce communication image and communi- 
cation sound, and transmitting the thus produced com- 
munication image and communication sound, the mo- 
bile terminal receiving the communication image and 
the communication sound, displaying the communica- 
tion image, outputting the communication sound, and 
transmitting a request of transmission of broadcast data 
to the control apparatus, the control apparatus request- 
ed the broadcast-transmitting server to transmit thereto 
the broadcast data requested by the mobile terminal, the 
broadcast-transmitting server separating one or a plu- 
rality of broadcast provided through broadcast-distribu- 
tion service, into broadcast image and broadcast data, 
and transmitting the requested broadcast data to the 
control apparatus, and the control apparatus receiving 
the broadcast data and transmitting the thus received 
broadcast data to the mobile terminal. 
[0042] It is preferable that the mobile terminal re- 
quests the control apparatus to synthesize the broad- 
cast data received by the control apparatus, the control 
apparatus synthesizes the broadcast data, the commu- 
nication image and the communication sound with one 
another, and transmits them to the mobile terminal, and 
the mobile terminal receives and outputs the communi- 
cation image and the communication sound to which the 
broadcast data has been synthesized. 
[0043] In the ninth aspect of the present invention, 
there is provided a method of looking at and listening to 
broadcast among a broadcast-transmitting server, a plu- 
rality of mobile terminals, and a control apparatus for 
looking at and listening to broadcast and making com- 
munication in multi-point which apparatus is connected 
to the broadcast-transmitting server and the mobile ter- 
minals through a communication network, including the 
control apparatus receiving images and sound from one 
or a plurality of mobile terminat(s), synthesizing the im- 
ages and the sound with one another, respectively, to 
thereby produce communication image and communi- 
cation sound, and transmitting the thus produced com- 
munication image and communication sound, the mo- 
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bile terminal receiving the communication image and 
the communication sound, displaying the communica- 
tion image, outputting the communication sound, and 
transmitting a request of transmission of broadcast im- 
age to the control apparatus, the control apparatus re- 
quested the broadcast-transmitting server to transmit 
thereto the broadcast image requested by the mobile 
terminal, the broadcast-transmitting server separating 
one or a plurality of broadcast provided through broad- 
cast-distribution service, into broadcast image and 
broadcast data, and transmitting the requested broad- 
cast image to the control apparatus, and the control ap- 
paratus receiving the broadcast image and transmitting 
the thus received broadcast image to the mobile termi- 
nal. 

[0044] It is preferable that the mobile terminal re- 
quests the control apparatus to synthesize the broad- 
cast image received by the control apparatus, the con- 
trol apparatus synthesizes the broadcast image, the 
communication image and the communication sound 
with one another, and transmits them to the mobile ter- 
minal, and the mobile terminal receives and outputs the 
communication image and the communication sound to 
which the broadcast image has been synthesized. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0045] 

FIG. 1 is a block diagram of a system for looking at 
and listening to television programs through the use 
of a broadcast-transmitting server and a mobile ter- 
minal, in accordance with the first embodiment of 
the present invention. 

FIG. 2 is a flow-chart showing an operation of the 
system in accordance with the first embodiment of 
the present invention. 

FIG. 3 is a flow-chart showing an operation of a mo- 
bile terminal used in the system in accordance with 
the first embodiment of the present invention. 
FIG. 4 is a block diagram of an example of the sys- 
tem in accordance with the first embodiment of the 
present invention. 

FIG. 5 is a block diagram of an example of a mobile 
terminal having a function of a television telephone. 
FIG. 6 is a block diagram of a system for looking at 
and listening to television programs through the use 
of a broadcast-transmitting server and a mobile ter- 
minal, in accordance with the second embodiment 
of the present invention. 

FIG. 7 is a flow-chart showing an operation of the 
system in accordance with the second embodiment 
of the present invention. 

FIG. 8 is a flow-chart showing an operation of the 
system in accordance with the second embodiment 
of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0046] Preferred embodiments in accordance with the 
5 present invention will be explained hereinbelow with ref- 
erence to drawings. 

[0047] FIG. 1 is a block diagram of a system for look- 
ing at and listening to television programs through the 
use of a broadcast-transmitting server and a mobile ter- 
io minal, in accordance with the first embodiment of the 
present invention. 

[0048] As illustrated in FIG. 1 , the system for looking 
at and listening to television programs, in accordance 
with the first embodiment, is comprised of a television 

'5 broadcast transmitting server 1 00, a plurality of mobile 
terminals 200, and a communication network NW inter- 
actively connecting them to each other. The communi- 
cation network NW may be comprised of a packet- 
switching network of public line, an internet network or 

20 a public line-switching network. The communication net- 
work NW includes all networks transmitting data through 
radio-signals and wires. 

[0049], The television broadcast transmitting server 
100 connects a television broadcast station (not illus- 

25 trated) and the mobile terminals 200 to each other. The 
television broadcast transmitting server 100 receives 
television programs transmitted from one or more tele- 
vision broadcast station(s), and distributes the received 
television programs to clients, that is, the mobile termi- 

30 nals 200 for counter value or free of charge. Each of the 
mobile terminals 200 is owned by a user, and is fabri- 
cated in a small size and in a small weight such that a 
user can readily carry it with him or her. Each of the mo- 
bile terminals 200 is designed to be able to receive tel- 

35 evision broadcast service on making access to the tel- 
evision broadcast transmitting server 100 through the 
communication network NW through radio-signals, or 
modulars of public phones and wires. 
[0050] The mobile terminals 200 in the first embodi- 

40 ment can be designed to be used as a cellular phone. 
[0051] Hereinbelow is explained an example of a 
structure of the television broadcast transmitting server 
100 and the mobile terminals 200. 
[0052] For simplification of explanation, the example 

45 explained hereinbelow refers to distribution service of 
BS digital broadcast. However, it should be noted that 
the present invention may be applied to distribution 
service of any digital broadcast including ground-wave 
digital broadcast, as well as distribution service of BS 

50 digital broadcast, and that the present invention may be 
applied to distribution service of analog broadcast which 
distributes not only images and sound, but also data 
such as characters. In addition, two or more broadcast 
may be distributed in the distribution service, which is 

55 applied to embodiments mentioned later. 

[0053] The television broadcast transmitting server 
100 is comprised of a television broadcast receiver 1 01 
which receives BS digital broadcast, a separator 102 
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which separates the received BS digital broadcast into 
image/sound signals and broadcast data in each of 
channels, a data-form converter 103 which converts a 
form of the broadcast data into a form suitable for being 
displayed in the mobile terminal 200, a data transmitter 
104 which transmits the broadcast data having been 
converted by the data-form converter 103 with respect 
to a form, to the mobile terminal 200, an image/sound- 
form converter 1 05 which converts a form of the image/ 
sound signals for each of channels into a form suitable 
for being reproduced and displayed in the mobile termi- 
nal 200, and a distributor 106 which, on receipt of a re- 
quest from the mobile terminal(s) 200 to transmit the im- 
age/sound signals in a particular channel, concurrently 
distributes the requested image/sound signals among 
the image/sound signals having been converted by the 
image/sound-form converter 1 05 with respect to a form, 
to all of the mobile terminals 200 having transmitted the 
request. 

[0054] The receiver 1 01 is comprised of a terminal for 
receiving BS digital broadcast, set in each home, for in- 
stance. Since it is necessary for the receiver 101 to al- 
ways receive television programs now being broadcast 
in all channels, the receiver 101 includes a plurality of 
terminals for receiving BS digital broadcast in each of 
channels such as BS-1 or BS-2. With the receiver 101 
including such a plurality of terminals, the separator 1 02, 
the data-form converter 103 and the image/sound-form 
converter 1 05 are designed to have a multiplexed struc- 
ture in order to concurrently carry out separation, con- 
version of a data form, and conversion of an image/ 
sound form. 

[0055] The distributor 106 is comprised of a plurality 
of transmitters 107 each of which transmits image/ 
sound signals in a channel requested by the mobile ter- 
minal 200, to the mobile terminal 200 which transmitted 
a request of transmission of image/sound signals in a 
particular channel to the distributor 106, and a multi- 
caster 1 08 efficiently distributes image/sound signals in 
a channel requested by the transmitter 107 among im- 
age/sound signals in channels, received from the im- 
age/sound-form converter 105, to the transmitter 107 
which transmitted a request of transmission of image/ 
sound signals in a particular channel to the mufti-caster 
108. 

[0056] The distributor 106 includes the necessary 
number of the transmitters 107. The multi-caster 108 
monitors whether each of the transmitters 1 07 is in use 
or not. On receipt of a request from the mobile terminal 
200 to transmit images and sound of a television pro- 
gram to the mobile terminal 200, the multi-caster 108 
determines one transmitter 1 07 among the transmitters 
107 not used at that time, and assigns the thus deter- 
mined transmitter 1 07 to the mobile terminal 200 having 
transmitted the request, in order to transmit images and 
sound to the mobile terminal 200. 
[0057] The mobile terminals 200 have a common 
structure to one another, and each of the mobile termi- 
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nals 200 is comprised of an input device 201 for receiv- 
ing inputs from a user, such as a keyboard, a broadcast- 
data receiver 202 for receiving broadcast data transmit- 
ted from the television broadcast transmitting server 
5 100, a receiver 203 which transmits a request of trans- 
mission of image/sound signals in a channel indicated 
by a user, to the television broadcast transmitting server 
100, and receives image/sound signals transmitted from 
the television broadcast transmitting server 100 in re- 
ft? sponse to the request, a communicator 204 which ap- 
plies a function of a cellular phone to the mobile terminal 
200, a sound input device 205 such as a microphone for 
introducing user's voice to the communicator 204, a dis- 
play unit 206 such as a liquid crystal display device, a 
is sound output device 207 such as a speaker, a display 
controller 208 which displays broadcast data received 
in the broadcast-data receiver 202 and images received 
in the receiver at the display unit 206, a reproduction 
controller 209 which outputs both voices received in the 
20 receiver 203 and voices of a caller received in the com- 
municator 204 through the sound output device 207, 
and a power source (not illustrated) feeding power to 
the above-mentioned parts. 

[0058] FIG. 2 is a flow-chart showing an operation of 

25 the system including the television broadcast transmit- 
ting server 1 00 and the mobile terminals, in accordance 
with the first embodiment. Hereinbelow is explained an 
operation of the system in accordance with the first em- 
bodiment, with reference to FIG. 2. 

30 [0059] The television broadcast transmitting server 
100 always receives BS digital broadcast through its tel- 
evision broadcast receiver 101 , in step S100. 
[0060] BS digital broadcast provides television pro- 
grams in each of channels, and further provides EPG. 

35 in addition, the television programs provide images and 
sound, and an interactive program in which a television 
viewer can take part and/or data indicative of present 
score of sport games, multiplexed to the television pro- 
gram, are also transmitted. 

40 [0061] The separator 102 separates the television 
programs into broadcast image and sound, and broad- 
cast data other than images and sound, specifically, 
EPG and prog ram- related data, in step S110. 
[0062] The broadcast data is described in a broadcast 

45 markup language (BML). However, BML is a markup 
language suitable for being displayed in a television 
screen, and hence, is frequently not suitable for being 
displayed in a small screen of the mobile terminal 200. 
Accordingly, the data-form converter 103 converts a 

50 form of the broadcast data into a proper form (an exam- 
ple of a proper data form will be explained later), in step 
S120. 

[0063] The broadcast data having been converted by 
the data-form converter 1 03 with respect to a data form 
55 is transmitted to the mobile terminal 200 through the da- 
ta transmitter 104. 

[0064] The images and sound separated from the tel- 
evision programs by the separator 102 in each of chan- 



EP 1 343 322 A1 



7 



BNSDCCID: <EP 1343322A1J_> 



EP 1 343 322 A1 



14 



13 

nels are transmitted to the image/sound-form converter 
105. 

[0065] Images and sound are encoded in accordance 
with MPEG-2 which is an encoding system as one of 
ISO standards. However, MPEG-2 is accompanied with 
problems that a resolution of images is too high and 
communication volume is too large for an ordinary mo- 
bile terminal to look at images and listen to sound. 
Hence, the image/sound-form converted 1 05 converts a 
form of the images and sound into a form suitable for 
being received by the mobile terminal 200, in step S1 40. 
[0066] For instance, if the images are encoded in ac- 
cordance with MPEG-4 which is an encoding system as 
one of ISO standards, a resolution of images is reduced, 
and the images become suitable for being looked at in 
the mobile terminal 200. With respect to the sound, it is 
preferable that the sounds are encoded in accordance 
with a sound-encoding system such as AMR to reduce 
a bit rate. 

[0067] The images and sound having been converted 
by the image/sound-form converter 105 with respect to 
a form in each of channels are concurrently transmitted 
to a plurality of the transmitters 107 through the multi- 
caster 108, in step S150. 

[0068] The image/sound-form converter 1 05 converts 
an image/sound form in a plurality of channels, and the 
multi-caster 1 08 transmits the thus converted image and 
sound in a multi-casting manner. Each of the transmit- 
ters 107 selects a channel through which the images 
and sound are transmitted, in accordance with a request 
transmitted from the mobile terminal 200, receives prop- 
er images and sound from the multi-caster 108, and 
transmits the images and sound to the mobile terminal 
200, in step S160. 

[0069] The television broadcast transmitting server 
1 00 operates in the above-mentioned way. 
[0070] FIG. 3 is a flow-chart showing an operation of 
the mobile terminal 200 in the first embodiment. Here- 
inbelow is explained an operation of the mobile terminal 
200 with reference to FIG. 3. 

[0071] On receipt of a request of looking at television 
program from a user through the input device 201 (step 
S200), the mobile terminal 200 transmits a request of 
transmission of broadcast data to the data transmitter 
104 of the television broadcast transmitting server 1 00 
through the broadcast-data receiver 202 (step S210), 
and receives broadcast data including EPG or program- 
related data having been converted into a suitable form 
(step S220). 

[0072] The display controller 208 displays the broad- 
cast data received by the broadcast- data receiver 202, 
in a screen of the display unit 206 to show the broadcast 
data to a user (step S230). 

[0073] Looking at the displayed broadcast data, a us- 
er selects a channel corresponding to an interested pro- 
gram, through the input device 201 (step S240). After a 
user selected a channel, the receiver 203 transmits a 
request of transmission of images and sound associat- 



ed with the selected channel, to the distributor 106 of 
the television broadcast transmitting server 100 (step 
S250). 

[0074] The distributor 106 assigns one transmitter 
5 1 07 to the mobile terminal 200 transmitting the request, 
and then, transmits images and sound associated with 
the requested channel , through the thus assigned trans- 
mitter 107 (step S260). 

[0075] The receiver 203 receives the images and 
10 sound from the transmitter 107. The received images 
are displayed at the display unit 206 by the display con- 
troller 208, and the sound is output through the sound 
output device 207 by the reproduction controller 209. 
Thus, a user can look at and listen to a television pro- 
fs gram associated with the selected channel (step S270). 
[0076] On the other hand, if a dial number is input and 
a calling step is carried out through the input device 210, 
a call is made by the communicator 204 similarly to an 
ordinary cellular phone, and hence, a user can make 
20 communication with a dialed person (step S280). In the 
communication, user's sound is input through the sound 
input device 205 : and sound of a dialed person is output 
through the sound output device 207 by the reproduc- 
tion controller 209. A dialed person may have another 
25 mobile terminal 200 or a fixed telephone. 

[0077] The mobile terminal 200 may be designed for 
a user to select a function of making communication, a 
function of looking at and listening to a television pro- 
gram, or both. When the mobile terminal 200 is designed 
30 to be able to provide both a function of making commu- 
nication and a function of looking at and listening to a 
television program, the reproduction controller 209 mix- 
es sound of a television program received by the receiv- 
er 203 and voices of a person with whom a user of the 
35 mobile terminal 200 is making communication, received 
by the communicator 204, to each other, and then, out- 
puts the mixed sound through the sound output device 
207. 

[0078] FIG. 4 is a block diagram of an example of the 

40 above-mentioned first embodiment. 

[0079] The television broadcast transmitting server 
100 separates received television broadcast into broad- 
cast data including program-related data comprised of 
EPG, a progress of a program and so on, and images 

45 and sound of programs in each of channels. If the broad- 
cast data is described in HTML which is a data form 
available in World Wide Web (WWW) presently globally 
used, availability of the broadcast data is increased. It 
is preferable in particular that the broadcast data is de- 

50 scribed in compact HTML (C-HTML) for the mobile ter- 
minal 200 to be able to look at the broadcast data. Ac- 
cordingly, it is preferable for the data-form converter 1 03 
of the television broadcast transmitting server 100 to 
have a function of converting broadcast data described 

55 in BAIL, into broadcast data described in C-HTML. 

[0080] If hyperlink to images of television programs 
relating to the broadcast data is used, it would be pos- 
sible to carry out such data-form conversion that broad- 
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cast data and broadcast images are related to each oth- 
er and a user can readily understand relation between 
them. The broadcast data in C-HTML form is stored in 
a memory (not illustrated) to which the data transmitter 
104 can make access, and is updated at any time, in 
which case, the data transmitter 104 is constituted as a 
WWW server which interprets HTTP protocol and trans- 
mits broadcast data including a program list and pro- 
gram-related data both described in C-HTML, in com- 
pliance with a request transmitted from the mobile ter- 
minal 200 as a client. 

[0081 ] The broadcast-data receiver 202 of the mobile 
terminal 200 may be designed to have any structure, if 
it can transmit a request of transmission of broadcast 
data to the data transmitter 1 04 acting as a WWW serv- 
er, receive the requested broadcast data, and display 
the received broadcast data through the display control- 
ler 208. For instance, by virtue of presently popularized 
"i-mode" of a cellular phone, the mobile terminal 200 can 
transmit a request to the data transmitter 1 04 acting as 
a WWW server to transmit broadcast data including a 
program list and program-related data through a packet- 
switching network NW1 available for mobile communi- 
cation, and display the received broadcast data in the 
display unit 206 of the mobile terminal 200. In this case, 
the broadcast data is transmitted in the form of packets. 
[0082] By carrying out the above-mentioned steps, a 
user can look at a program list such as an example of a 
data-displayed screen 2021 , through the mobile termi- 
nal 200. If a user selects a program the detail of which 
he or she would like to see, he or she can look at the 
detail of the selected program or program-related data 
indicative of a progress of the program, such as an ex- 
ample of a data-displayed screen 2022. 
[0083] In the case that a progress of a program suc- 
cessively varies as a program of a sport game, the data 
transmitter 1 04 successively transmits data in so-called 
pushing manner, and the broadcast-data receiver 202 
receives successively transmitted data. Thus, a user 
can check a progress of a program. Data transmission 
may be carried out in pseudo-pushing manner in which 
the broadcast-data receiver 202 successively transmits 
a request of data transmission to the data transmitter 
104. 

[0084] Seeing the display screen, a user can select a 
channel associated with images which he or she would 
like to see, in a program list. Seeing a progress of a cer- 
tain program, a user may would like to see not only pro- 
gram-related data, but also images of the program, 
since he or she has an interest in further progress of the 
program. In such cases, by selecting a channel through 
the input device 201 . the receiver 203 of the mobile ter- 
minal 200 makes communication with one of the trans- 
mitters 1 07 of the television broadcast transmitting serv- 
er 100, receives a stream of the images and sound of 
the program from the transmitter 107, displays the re- 
ceived images in the display unit 206 through the display 
controller 208, and outputs the sound from the sound 



output device 207 through the reproduction controller 
209. For instance, the display controller 208 may display 
the broadcast data received by the broadcast-data re- 
ceiver 202, in an upper half of a screen of the display 

5 unit 206, and display the images received by the receiv- 
er 203, in a lower half of a screen of the display unit 206, 
so that a user can concurrently look at the broadcast 
data and the broadcast images. 
[0085] A protocol for transmuting and receiving imag- 

10 es and sound should not be limited to a particular pro- 
tocol. However, in a system in which a program is once 
recorded and stored in a server, and the program is 
downloaded to the mobile terminal 200 after the pro- 
gram ended, it is not possible to accomplish real-time 

15 action in which a user can look at a program now on air 
at real-time, and in addition, it would take much time to 
download the program to the mobile terminal 200, and 
resultingly, a user may not be able to see a program 
while the program is being downloaded to his or her mo- 

20 bile terminal 200. Accordingly, it is preferable to select 
a protocol by which images are transmitted picture by 
picture, and sound is divided into a plurality of sections 
each having a certain period of time, and then, transmit- 
ted section by section, and further by which the mobile 

25 terminal 200 joins the pictures and the sections together 
to thereby provide a user with the images and sound. 
[0086] As such a protocol, there may be used H.324 
defined by ITU-T for next generation cellular phone, for 
instance. The protocol H.324 accomplishes a television 

30 telephone in which a user transmits his or her image and 
sound to a dialed person and receives a dialed person's 
image and sound through a line-switching network for 
mobile communication to thereby make it possible for a 
user to make communication with a dialed person, look- 

35 ing at images of a dialed person at real-time. According- 
ly, it would be possible to look at and listen to broadcast 
image and sound at real-time by installing the protocol 
H.324 into the transmitters 1 07 of the television broad- 
cast transmitting server 1 00 and the receiver 203 of the 

40 mobile terminal 200, and further by making communica- 
tion between them through the line-switching network 
NW2 to be used for mobile communication. 
[0087] The images and sound may be transmitted 
through an internet as well as the line-switching network 

45 NW2, in which case, it would be possible to look at and 
listen to the broadcast images and sound in accordance 
with the protocol H.323 defined by ITU-T, in which the 
broadcast images and sound are transmitted as packets 
similarly to the broadcast data. 

so [0088] In the first embodiment, the mobile terminal 
200 is designed to have a function as a telephone mak- 
ing communication with others through voices. Howev- 
er, the mobile terminal 200 may be designed to have a 
camera to thereby have a function as a television tele- 

55 phone similar to a next-genexation type cellular phone. 
[0089] FIG. 5 is a block diagram of an example of a 
structure of the mobile terminal 200 having a function of 
a television telephone. 
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[0090] The communicator 204 in the mobile terminal 
200 illustrated in FIG. 5 is electrically connected not only 
to the communicator 205, but also to an image input de- 
vice 210 such as a digital camera, and hence, the com- 
municator 204 has a function of making communication 5 
in not only sound, but also images with another tele- 
phone having a function of a television telephone. 
[0091] Images of a dialed person, received by the 
communicator 204, are displayed in the display unit 206 
by the display controller 208. The mobile terminal 200 10 
may be designed to carry out looking at and listening to 
television broadcast or making communication as a tel- 
evision telephone. As an alternative, the mobile terminal 
200 may be designed to carry out both. If the mobile 
terminal 200 is designed to enable a user to both look *5 
at and listen to a television program, and make commu- 
nication with others in the form of a television telephone, 
the display controller 208 concurrently displays the 
broadcast images received by the receiver 203 and im- 
ages of a dialed person received by a function of a tel- 20 
evision telephone, in a screen of the display unit 206. 
For instance, a screen of the display unit 206 may be 
divided into two areas, and the broadcast images and a 
dialed person's images may be displayed in each of the 
two areas. In addition, the broadcast data received by 25 
the broadcast-data receiver 202 may be displayed to- 
gether. 

[0092] The reproduction controller 209 mixes televi- 
sion sound and communication sound to each other, 
and outputs the thus mixed sound through the sound 30 
output device 207, similarly to the mobile terminal 200 
illustrated in FIG. 1 . 

[0093] The mobile terminal 200 having a function of a 
television telephone may be used in a multi-point con- 
ference in which communication is made among a plu- 35 
rality of points. In such a multi-point conference, it would 
be quite convenient for participants, if they can look at 
a television program during a conference, or commonly 
have images of a television program. Hereinbelow is ex- 
plained an example in which the present invention is ap- 40 
plied to a multi-point conference. 
[0094] FIG. 6 is a block diagram of a system for look- 
ing at and listening to a television program, in accord- 
ance with the second embodiment of the present inven- 
tion, including a television broadcast transmitting server, 
a control apparatus for looking at and listening to a tel- 
evision program and making communication in multi- 
point, and mobile terminals. 

[0095] The system for looking at and listening to a tel- 
evision program, in accordance with the second embod- so 
iment, is comprised of a television broadcast transmit- 
ting server 1 00, a plurality of mobile terminals 200 each 
equipped with a camera, a control apparatus 300 for 
looking at and listening to a television program and mak- 
ing communication in multi-point, and a communication 55 
network NW connecting them to one another. 
[0096] In comparison with the television broadcast 
transmitting server 100 illustrated in FIG. 1 in the first 



embodiment, the television broadcast transmitting serv- 
er 1 00 in the second embodiment operates in the same 
manner as that of the television broadcast transmitting 
server 1 00 in the first embodiment except the data trans- 
mitter 1 04 and the distributor 1 06. 
[0097] The data transmitter 104 of the television 
broadcast transmitting server 1 00 in the second embod- 
iment transmits the broadcast data not only tothe mobile 
terminal 200 which made direct access thereto, but also 
to the control apparatus 300. The distributor 106 trans- 
mits the broadcast image and sound to the mobile ter- 
minal. 200 which made direct access to the television 
broadcast transmitting server 1 00, receives a request of 
transmission of images and sound of a television pro- 
gram from the control apparatus 300, assigns the trans- 
mitter 107 which is now not in operation, to the control 
apparatus 300, and transmits the broadcast images and 
sound to the control apparatus 300. 
[0098] Each of the mobile terminals 200 has an input 
device 210 comprised of a digital camera, for instance, 
and hence, can make communication as a television tel- 
ephone. Thus, the mobile terminal 200 can be used for 
a conference. The mobile terminal 200 in the second 
embodiment has the same structure as the structure il- 
lustrated in FIG. 5 except that the mobile terminal 200 
in the second embodiment can look at and listen to a 
television program, and concurrently make communica- 
tion as a television telephone. 

[0099] When a plurality of users attend to a confer- 
ence, each using the mobile terminal 200 having a func- 
tion of a television telephone, it would be necessary to 
prepare a multi-point control unit (MCU). In order for a 
plurality of users attending to a conference to be able to 
commonly have images transmitted from the television 
broadcast transmitting server 1 00 during a conference, 
the control apparatus 300 in the second embodiment is 
designed to have not only functions which a convention- 
al control apparatus has, but also functions of causing 
a plurality of the mobile terminals 200 to have images 
and sound of a television program. 
[0100] The control apparatus 300 in the second em- 
bodiment is comprised of a request receiver 301 which 
receives a plurality of requests from the mobile terminals 
200 of participants attending to a conference, an image/ 
sound receiver 302 which receives images and sound 
of participants transmitted from a plurality of the mobile 
terminals 200 of participants attending to a conference, 
a broadcast-data receiver 307 which receives broadcast 
data from the television broadcast transmitting server 
100 in compliance with a request transmitted from the 
mobile terminal(s) of a participant(s) attending to a con- 
ference, a broadcast-data transmitter 308 which trans- 
mits the broadcast data received from the television 
broadcast transmitting server 100, to the mobile termi- 
nals) 200 which transmitted a request of transmission 
of the broadcast data, a receiver 305 which receives 
broadcast images and sound from the television broad- 
cast transmitting server 100 in compliance with the re- 
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quests transmitted from the mobile terminals 200 of par- 
ticipants attending to a conference, an image/sound 
transmitter 306 transmits the broadcast images and 
sound received from the television broadcast transmit- 
ting server 100, to the mobile terminal(s) 200 which 
transmitted a request of transmission of the broadcast 
images and sound, an image/sound synthesizer 304 
which synthesizes images and sound of a dialed person 
received by the image/sound receiver 302 to each other, 
respectively, and further synthesizes the broadcast data 
received by the broadcast-data receiver 307 or the 
broadcast images and sound received by the receiver 
305 to images and sound of a dialed person, if requested 
by the request receiver 301, and a multi-point image/ 
sound transmitter 303 which transmits the images and 
sound having been synthesized by the image/sound 
synthesizer 304, to the mobile terminals 200 of the par- 
ticipants attending to a conference. 
[0101] FIGs. 7 and 8 are flow-charts showing an op- 
eration of the system in accordance with the second em- 
bodiment including the television broadcast transmitting 
server 100 : the control apparatus 300 and the mobile 
terminals 200. Hereinbelow is explained an operation of 
the system with reference to FIGs. 7 and 8. 
[01 02] The system in accordance with the second em- 
bodiment operates in the same way as the first embod- 
iment in the case that each of the mobile terminals 200 
makes direct access to the television broadcast trans- 
mitting server 100, and receives distribution of a televi- 
sion program. Hereinbelow is explained a case where a 
plurality of users attend to a conference, each using the 
mobile terminal 200. 

[0103] The control apparatus 300 connects a plurality 
of the mobile terminals 200 existing at various places, 
to one another in star-shaped connection through the 
mobile communication network NW in reservation or in- 
stantaneous connection manner. The control apparatus 
300 receives images of users and sound of their con- 
versation both transmitted from each of the mobile ter- 
minals 200, at the image/sound receiver 302 (step 
S300), and then, synthesizes a plurality of images of us- 
ers into one image and mixes sound of a plurality of us- 
ers to one another (step S310). 

[01 04] Synthesis of images of a plurality of users may 
be carried out by dividing a screen into sub-sections by 
the number of the mobile terminals 200 of participants 
attending to a conference, reducing a size of images of 
users, and assigning the reduced images into each of 
the sub-sections, for instance. 

[0105] The synthesized images and sound are trans- 
mitted to each of the mobile terminals 200 of participants 
attending to a conference, through the control apparatus 
300 (step S320). 

[0106] Each of the mobile terminals 200 receives the 
images and sound transmitted from the multi-point im- 
age/sound transmitter 303, through the communicator 
204. The received images are displayed at the display 
unit 206 by the display controller 208, and the sound is 



output through the sound output device 207 by the re- 
production controller 209 (step S330). Thus, a plurality 
of users existing at various places can attend to a con- 
ference, looking at images of other users. 

5 [0107] If a user attending to a conference transmits a 
request of transmission of broadcast data thereto to the 
request receiver 301 of the control apparatus 300 
through the broadcast-data receiver 202 by operating 
the input device 201 of his or her mobile terminal 200 in 

io order to make communication with another person and 
concurrently look at broadcast data of a television pro- 
gram (step S340), the request receiver 301 transmits 
the received request to the broadcast-data receiver 307. 
[01 08] The broadcast-data receiver 307 transmits the 

15 request to the television broadcast transmitting server 
100 (step S350), receives broadcast data from the tel- 
evision broadcast transmitting server 100 in response 
to the request, and transmits the broadcast data to the 
broadcast-data receiver 202 of the mobile terminal 200 

20 which transmitted the request, through the broadcast- 
data transmitter 308 (step S360). 

[0109] The broadcast-data receiver 202 displays the 
received broadcast data in the display unit 206 through 
the display controller 208 (step S370). For instance, the 

25 display controller 208 causes the display unit 206 to dis- 
play the images of a dialed person received by the re- 
ceiver 203, in an upper half of a screen of the display 
unit 206, and the broadcast data in a lower half of the 
screen. Thus, the images of a dialed person and the 

30 broadcast data are displayed together at the display unit 
206. Thus, a user of the mobile terminal 200 can attend 
to a conference, looking at images of a dialed person, 
and further can look at broadcast data including EPG 
and program-related data. 

35 [01 10] If a user would like to show the broadcast data 
to other users, the user transmits a request of doing so 
to the request receiver 301 through the broadcast data 
receiver 202 by operating the input device 201 of his or 
her mobile terminal 200 (step S380). The request re- 

40 ceiver 301 instructs the broadcast-data receiver 307 to 
output the broadcast data to the image/sound synthe- 
sizer 304 (step S390), and further instructs the image/ 
sound synthesizer 304 to synthesize the broadcast da- 
ta. 

45 [0111] In response, the broadcast-data receiver 307 
transmits the broadcast data received from the televi- 
sion broadcast transmitting server 1 00, to the image/ 
sound synthesizer 304 (step S400). The image/sound 
synthesizer 304 synthesizes the images of a user and 

50 sound of conversation both received by the image/ 
sound receiver 302, to each other, and further synthe- 
sizes them to the broadcast data, and then, transmits 
the thus synthesized images, sound and broadcast data 
to the multi-point image/sound transmitter 303 (step 

55 S410). 

[0112] In synthesis of the user's images and the 
broadcast data, images of a plurality of users synthe- 
sized to one another are displayed on an upper half of 
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a screen, and the broadcast data is displayed in a lower 
half of the screen, similarly to the case mentioned ear- 
lier, for instance. 

[0113] The multi-point image/sound transmitter 303 
transmits the thus synthesized images and sound to s 
each of the mobile terminals 200 of the users attending 
to a conference (step S420). 

[01 14] Each of the mobile terminals 200 of the users 
attending to a conference receives the images and 
sound at the communicator 204 from the multi-point im- 10 
age/sound transmitter 303. The received images are 
displayed at the display unit 206 through the display 
controller 208, and the sound is output through the 
sound output device 207 by the reproduction controller 
209 (step S430). Thus, users existing at various places is 
can attend to a conference, looking at others users' im- 
ages, and all of the users can look at the same broadcast 
data. 

[01 1 5] If the broadcast-data receiver 202 of the mo- 
bile terminal 200 transmits a request of transmission of 20 
only users' images or transmission of only the broadcast 
data to the request receiver 301 , the image/sound syn- 
thesizer 304 stops synthesis of the broadcast data, and 
the multi-point image/sound transmitter 303 transmits 
only the users' images and sound or only the broadcast 25 
data. 

[0116] It is assumed that while a user is looking at 
broadcast data such as EPG, he or she would like to 
look at and listen to images and sound of a certain tel- 
evision program. In such a case, he or she operates the 30 
input device of his or her mobile terminal 200 to transmit 
a request of looking at a television program together with 
indication of a channel to the request receiver 301 
through the receiver 203 (step S440 in FIG. 8). The re- 
quest receiver 301 transmits the received request to the 35 
receiver 305. The receiver 305 transmits the received 
request to the television broadcast transmitting server 
100 (step S450), and receives images and sound of a 
requested television program from the television broad- 
cast transmitting server 1 00 (step S460). 40 
[01 1 7] The receiver 305 transmits the received imag- 
es and sound to the receiver 203 of the mobile terminal 
200 which transmitted the request, through the image/ 
sound transmitter 306 (step S470). 

[01 18] The receiver 203 displays the received broad- *s 
cast images at the display unit 206 through the display 
controller 208, and outputs the received broadcast 
sound through the sound output device 207 by the re- 
production controller 209 (step S480). 
[0119] For instance, the display controller 208 dis- so 
plays the images of a dialed person received by the 
communicator 204, in an upper half of a screen of the 
display unit 206, and the broadcast images received by 
the receiver 203, in a lower half of the screen for con- 
currently displaying the images of a dialed person and 55 
the broadcast images at the display unit 206. 
[0120] The reproduction controller 209 mixes the 
voices of a dialed person received by the communicator 



204 and the broadcast sound received by the receiver 
203 to each other, and outputs the mixed sound through 
the sound output device 207. Thus, a user can make 
communication or attend to a conference, looking at im- 
ages of a dialed person, and further, looking at his or 
her favorite television program. 
[0121] It is assumed that all of users attending to a 
conference are necessary to look at images of a certain 
television program because the television program is a 
theme of the conference. Each of the users operates the 
input device 201 of his or her mobile terminal 200 to 
transmit a request of looking at images of a television 
program to the request receiver 301 through the receiv- 
er 203 (step S490). The request receiver 301 transmits 
an instruction to the receiver 305 to thereby cause the 
receiver 305 to transmit the images and sound received 
from the television broadcast transmitting server 1 00, to 
the image/sound synthesizer 304. The request receiver 
305 further transmits an instruction to the image/sound 
synthesizer 304 to synthesize the broadcast images and 
sound. 

[0122] In response, the receiver 305 transmits the 
broadcast images and sound received from the televi- 
sion broadcast transmitting server 100, to the image/ 
sound synthesizer 304. The image/sound synthesizer 
304 synthesizes the images of a user and sound of con- 
versation both received by the image/sound receiver 
302, to each other, and further synthesizes them to the 
broadcast data and broadcast sound, and then, trans- 
mits the thus synthesized images, sound and broadcast 
data and sound to the multi-point image/sound transmit- 
ter 303 (step S500). 

[0123] In synthesis of the user's images and the 
broadcast images, images of a plurality of users synthe- 
sized to one another are displayed on an upper half of 
a screen, and the broadcast images are displayed in a 
lower half of the screen, similarly to the case mentioned 
earlier, for instance. The sound of users' conversation 
and the broadcast sound are synthesized to each other 
by being mixed to each other. 

[0124] Then, the multi-point image/sound transmitter 
303 transmits the thus synthesized images and sound 
to each of the mobile terminals 200 of the users attend- 
ing to a conference (step S51 0). 
[0125] Each of the mobile terminals 200 of the users 
attending to a conference receives the images and 
sound at the communicator 204 from the multi-point im- 
age/sound transmitter 303. The received images are 
displayed at the display unit 206 through the display 
controller 208, and the sound is output through the 
sound output device 207 by the reproduction controller 
209 (step S520). 

[0126] Thus, users existing at various places can at- 
tend to a conference, looking at others users' images, 
and all of the users can look at the same television pro- 
gram. 

[0127] If the receiver 203 of the mobile terminal 200 
transmits a request of transmission of only users' imag- 
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es or transmission of only the television program to the 
request receiver 301 , the image/sound synthesizer 304 
stops synthesis of the broadcast images, and the multi- 
point image/sound transmitter 303 transmits only the us- 
ers' images and sound or only the broadcast images and 5 
broadcast sound. 

INDUSTRIAL APPLICABILITY 

[0128] As explained above, the present invention 10 
makes it possible even for a user who does not have an 
apparatus for receiving television broadcast, at his or 
her home to receive broadcast distribution service from 
a television broadcast transmitting serverthrough his or 
her mobile terminal, and hence, be able to looking at *5 
television programs, while he or she is out of his or her 
home. 

[0129] In addition, by designing the system in accord- 
ance with the present invention to further include a con- 
trol apparatus for looking at and listening to a television 20 
program and making communication in multi-point, us- 
ers can make communication with each other, looking 
at a television program, or can have a chat or attend to 
a conference, looking at common images. 
[0130] Specifically, the present invention provided the 25 
following advantages. 

[0131] First, even a user who does not have an appa- 
ratus for receiving television broadcast, at his or her 
home, can look at and listen to broadcast data and/or a 
television program. 30 
[0132] This is because a user can receive television 
broadcast distribution service by making access to a tel- 
evision broadcast transmitting serverthrough his or her 
mobile terminal while he or she is out of his or her home, 
and hence, he or she can look at and listen to broadcast 35 
data and a television program in an area in which radio- 
signals can reach at his or her mobile terminal, or in an 
area covered with public lines. 

[01 33] Second, a user can readily read broadcast da- 
ta even in a small screen of a mobile terminal. *o 
[01 34] This is because a data-form converter in a tel- 
evision broadcast transmitting server converts a form of 
broadcast data such as EPG into a form suitable for be- 
ing displayed in a screen of a mobile terminal. 
[0135] Third, a user can look at and listen to a televi- *s 
sion program even through a mobile terminal which has 
a small screen and small line capacity. 
[01 36] This is because an image/sound-form convert- 
er in a television broadcast transmitting server converts 
a form of broadcast image and sound signals in each of so 
channels into a form suitable for being displayed and 
reproduced in a mobile terminal. 

[0137] Fourth, it is possible to efficiently distribute 
broadcast images and sound to a plurality of mobile ter- 
minals. 55 
[0138] This is because a television broadcast trans- 
mitting server is designed to include a plurality of trans- 
mitters for transmitting broadcast images and sound to 



a plurality of mobile terminals, and a multi-caster which 
distributes broadcast image and sound separated from 
television broadcast by a separator for each of channels 
and broadcast images and sound output from an image/ 
sound-form converter in each of channels, into a plural- 
ity of transmitters in multi-casting manner. 
[0139] Fifth, a user can select his or her favorite tele- 
vision program through his or her mobile terminal. 
[0140] This is because a television broadcast trans- 
mitting server is designed to include transmitters which 
selects broadcast images and sound in a channel to be 
received from a multi-caster, in response to a request 
transmitted from a mobile terminal. 
[0141] Sixth , a user can look at and listen to broadcast 
to which broadcast data and broadcast images are syn- 
thesized. 

[0142] This is because a mobile terminal is designed 
to include a display controller which displays received 
broadcast data and broadcast images concurrently at a 
display unit. 

[0143] Seventh, a user can look at and listen to broad- 
cast contents in which data is dynamically updated. 
[01 44] This is because a broadcast-data receiver of a 
mobile terminal successively receives broadcast data 
successively transmitted from a television broadcast 
transmitting server, and a display controller successive- 
ly displays the received broadcast data at a display unit. 
[0145] Eighth, a user can make a call by his or her 
mobile terminal which has a function of looking at and 
listening to a television program. 
[0146] This is because a mobile terminal may be de- 
signed to have a function as a cellular phone. 
[0147] Ninth, a user can have a chat through a televi- 
sion telephone, looking at a television program. 
[0148] This is because a mobile terminal is designed 
to have functions of synthesizing images of a dialed per- 
son and broadcast images to each other and displaying 
the thus synthesized images at a display unit, and syn- 
thesizing voices of a dialed person and broadcast sound 
to each other and outputting the thus synthesized sound 
through a sound output device. 

[0149] Tenth, a user can look at broadcast data at low 
cost, and look at and listen to high-quality broadcast im- 
ages and sound by using line switching which provides 
broadcast images and sound having constant quality. 
[0150] This is because broadcast data can be trans- 
mitted as packets through a packet-switching network 
or an internet network of public line, and broadcast im- 
ages and sound can be transmitted through a line- 
switching network. 

[0151] Eleventh, a user can look at and listen to not 
only broadcast data, but also broadcast images and 
sound at low communication cost. 
[0152] This is because users can concurrently have 
a chat or attend to a conference through their mobile 
terminals, looking at a television program, or make con- 
versation or attend to a conference, looking at common 
images. 
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[01 53] This is because the system in accordance with 
the present invention may be designed to include a con- 
trol apparatus for looking at and listening to a television 
program and making communication in multi-point 
which apparatus has a function of allowing a plurality of 
mobile terminals to commonly have images and sound 
of a television program, as well as functions which a con- 
ventional control apparatus has. 



Claims 

1 . A broadcast-transmitting server comprising: 

a separator for separating one or a plurality of 
broadcast provided through broadcast-distribu- 
tion service, into broadcast images and broad- 
cast data; 

a data transmitter for transmitting said broad- 
cast data separated from said broadcast by 
said separator, to a mobile terminal; and 
a distributor which receives a request indicative 
of desired broadcast image determined based 
on said broadcast data, from said mobile termi- 
nal, and distributes said desired broadcast im- 
age among broadcast images separated from 
said broadcast by said separator, to said mobile 
terminal which transmitted said request to said 
distributor. 

2. The broadcast-transmitting server as set forth in 
claim 1 , wherein said distributor is comprised of: 

one or a plurality of transmitter(s) which trans- 
mits) said desired broadcast image requested 
by said mobile terminal based on said broad- 
cast data, to the mobile terminal which trans- 
mitted the request; and 

a multi-caster which provides said broadcast 
image requested by said transmitter among 
broadcast images separated from said broad- 
cast by said separator, to said transmitter which 
requested to receive said broadcast image. 

3. The broadcast-transmitting server as set forth in 
claim 2, wherein said multi-caster distributes said 
broadcast image separated from said broadcast by 
said separator, in a multi-casting way, and said 
transmitter(s) selects broadcast image or broadcast 
images among said broadcast images distributed 
from said multi-caster, in accordance with said re- 
quest transmitted from said mobile terminal. 

4. The broadcast-transmitting server as set forth in 
claim 2 or 3, wherein said distributor monitors 
whether said transmitter is in operation or not, and 
assigns a transmitter not in operation to said mobile 
terminal on receipt of said request from said mobile 



terminal. 

5. The broadcast-transmitting server as set forth in 
claim 1, 2, 3 or 4, further comprising a data-form 
5 converter which converts a form of said broadcast 

data separated from said broadcast by said sepa- 
rator, into a form suitable for being displayed in said 
mobile terminal. 

10 6. The broadcast-transmitting server as set forth in 
claim 1 , 2, 3, 4 or 5, further comprising a converter 
which converts a form of said broadcast image sep- 
arated from said broadcast by said separator, into 
a form suitable for being displayed or reproduced in 

15 said mobile terminal. 

7. Abroadcast-transmltting server comprising: 

a separator for separating one or a plurality of 
20 broadcast provided through broadcast- distribu- 

tion service, into broadcast images and broad- 
cast data; 

a data-transmitter which transmits said broad- 
cast data separated from said broadcast by 

25 said separator, to a control apparatus for look- 

ing at and listening to broadcast and making 
communication in multi-point which apparatus 
receives image and sound from one or a plural- 
ity of mobile terminal(s), and synthesizes image 

30 and sound, respectively, for producing commu- 

nication image and communication sound; and 
a distributor receives a request of transmission 
of desired broadcast image through said con- 
trol apparatus which request is determined in 

35 said mobile terminal in accordance with said 

broadcast data transmitted through said control 
apparatus, and transmits the requested desired 
broadcast image among said broadcast imag- 
es separated from said broadcast by said sep- 

40 arator, into said control apparatus which trans- 

mitted said request. 

8. The broadcast-transmitting server as set forth in 
claim 7, wherein said distributor is comprised of: 

45 

one or a plurality of transmitters) which receive 
(s) said request of transmission of desired 
broadcast image through said control appara- 
tus, and transmit(s) said requested desired 
50 broadcast image to said mobile terminal which 

transmitted said request, through said control 
apparatus; and 

a multi-caster which distributes broadcast im- 
age requested by said transmitter(s) among 
55 said broadcast images separated from said 

broadcast by said separator, to said transmitter 
(s) which transmitted said request. 
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9. The broadcast-transmitting server as set forth in 
claim 7 or 8, wherein said multi-caster distributes 
said broadcast image separated from said broad- 
cast by said separator, in a multi-casting way, and 
said transmitter(s) selects broadcast image or 
broadcast images among said broadcast images 
distributed from said multi-caster in accordance 
with said request transmitted from said mobile ter- 
minal through said control apparatus. 

10. The broadcast-transmitting server as set forth in 
claim 7, 8 or 9, further comprising a data-fomn con- 
verter which converts a form of said broadcast data 
separated from said broadcast by said separator, 
into a form suitable for being displayed in said mo- 
bile terminal making communication with said con- 
trol apparatus. 

11. The broadcast-transmitting server as set forth in 
claim 7, 8, 9 or 10, further comprising a converter 
which converts a form of said broadcast image sep- 
arated from said broadcast by said separator, into 
a form suitable for being displayed or reproduced in 
said mobile terminal making communication with 
said control apparatus. 

12. A control apparatus for looking at and listening to 
broadcast and making communication in multi- 
point, comprising: 

a request receiver which receives requests 
from mobile terminals; 

an image/sound receiver which receives image 
and sound transmitted from said mobile termi- 
nals; 

a broadcast-data receiver which receives, from 
a broadcast-transmitting server which sepa- 
rates one or a plurality of broadcast provided 
through broadcast-distribution service, into 
broadcast images and broadcast data, and dis- 
tributes said broadcast images and said broad- 
cast data, said broadcast data in accordance 
with a request transmitted from said mobile ter- 
minal; 

a receiver which receives a request of transmis- 
sion of desired broadcast image determined by 
said mobile terminal in accordance with said 
broadcast data, transmits said request to said 
broadcast-transmitting server, and receives 
said desired broadcast image from said broad- 
cast-transmitting server; 
an image/sound synthesizer which synthesizes 
image and sound received by said image/ 
sound receiver for producing communication 
image and communication sound, and, on re- 
ceipt of a request from said request receiver, 
synthesizes said broadcast data received by 
said broadcast-data receiver or said broadcast 



image received by said receiver and said com- 
munication image and sound with each other; 
and 

a multi-point image/sound transmitter which 
5 transmits said communication image and 

sound having been synthesized with said 
broadcast data or said broadcast image in said 
image/sound receiver, to said mobile terminal. 

w 13. The control apparatus as set forth in claim 1 2, fur- 
ther comprising: 

a broadcast-data transmitter which transmits 
said broadcast data received by said broad- 

15 cast-data receiver, to said mobile terminal 

transmitting said request; and 
an image/sound transmitter which transmits 
said broadcast image received by said receiver, 
to said mobile terminal transmitting said re- 

20 quest. 

14. The control apparatus as set forth in claim 12 or 13, 
wherein said broadcast data is transmitted as pack- 
ets through packet-switching network or internet 
25 network of public line, and said broadcast image, 
said communication image and said communica- 
tion sound are transmitted through line-switching 
network. 

30 15. A mobile terminal comprising: 

a broadcast-data receiver which receives, from 
a broadcast-transmitting server which sepa- 
rates one or a plurality of broadcast provided 

35 through broadcast-distribution service, into 

broadcast images and broadcast data, and dis- 
tributes said broadcast images and said broad- 
cast data, said broadcast data; 
a receiver which transmits a request of trans- 

40 mission of desired broadcast image deter- 

mined in accordance with said broadcast data, 
to said broadcasting-transmitting server, and 
receives said desired broadcast image from 
said broadcast-transmitting server; and 

45 a display controller which displays said broad- 

cast data received by said broadcast-data re- 
ceiver or said broadcast image received by said 
receiver. 

50 16. The mobile terminal as set forth in claim 15, wherein 
said display controller concurrently displays said 
broadcast data received by said broadcast-data re- 
ceiver and said broadcast image received by said 
receiver. 

55 

17. The mobile terminal as set forth in claim 15 or 16, 
wherein said receiver receives broadcast sound, 
and further comprising a reproduction controller 
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which outputs received broadcast sound. 

18. The mobile terminal as set forth in claim 15, 16 or 
17 wherein said broadcast-data receiver succes- 
sively transmits a request of transmission of said 5 
broadcast data to said broadcast-transmitting serv- 
er, and successively receives said broadcast data 
from said broadcast-transmitting server, and 

said display controller successively displays 10 
said broadcast data received by said broad- 
cast-data receiver. 

19. The mobile terminal as set forth in claim 15, 16 or 

1 7 wherein said mobile terminal works as a cellular is 
phone. 

20. The mobile terminal as set forth in claim 17, 1B or 
19, wherein said mobile terminal has a function of 

a cellular phone which makes communication with 20 
other phones through sound and image, 

said display controller displays image of a per- 
son with which said mobile terminal makes 
communication, or said broadcast image, and 25 
said reproduction controller outputs voice of a 
person with which said mobile terminal makes 
communication, or said broadcast sound. 

21 . A mobile terminal comprising: 30 

a communicator which receives, from a control 
apparatus for looking at and listening to broad- 
cast and making communication in multi-point 
which apparatus receives images and sound 35 
from one or a plurality of mobile terminal(s), and 
synthesizes said images and said sound with 
one another, respectively, to thereby produce 
communication image and communication 
sound, said communication image and said *o 
communication sound; 

a broadcast-data receiver which transmits a re- 
quest of transmission of broadcast data to said 
control apparatus, causes said control appara- 
tus to receive the requested broadcast data *5 
from a broadcast-transmitting server which 
separates one or a plurality of broadcast pro- 
vided through broadcast-distribution service, 
into broadcast images and broadcast data, and 
distributes said broadcast images and said so 
broadcast data, and receives said requested 
broadcast data from said control apparatus; 
and 

a receiver which transmits a request of trans- 
mission of desired broadcast image deter- 55 
mined in accordance with said broadcast data 
received by said broadcast-data receiver, to 
said control apparatus, and receives said de- 



sired broadcast image from said broadcast- 
transmitting server. 

22. The mobile terminal as set forth in claim 21 , wherein 
said broadcast-data receiver transmits a request of 
synthesizing said broadcast data to said communi- 
cation image to said control apparatus, and causes 
said control apparatus to synthesize said broadcast 
data and said communication image to each other 
and transmit said communication sound and said 
communication image to which said broadcast data 
has been synthesized, and 

said communicator receives said communica- 
tion sound and said communication image to 
which said broadcast data has been synthe- 
sized, from said control apparatus. 

23. The mobile terminal as set forth in claim 21 or 22, 
wherein said receiver transmits a request of synthe- 
sizing said broadcast image to said communication 
image to said control apparatus, and causes said 
control apparatus to synthesize said broadcast im- 
age and said communication image to each other 
and transmit said communication sound and said 
communication image to which said broadcast im- 
age has been synthesized, and 

said communicator receives said communica- 
tion sound and said communication image to 
which said broadcast image has been synthe- 
sized, from said control apparatus. 

24. The mobile terminal as set forth in claim 21 , 22 or 
23, wherein said receiver receives broadcast 
sound, and further comprising: 

a display controller which displays at least one 
of said broadcast data received by said broad- 
cast-data receiver, said broadcast image re- 
ceived by said receiver, and said communica- 
tion image received by said communicator; and 
a reproduction controller which outputs said 
communication sound received by said receiv- 
er or said communication sound received by 
said communicator. 

25. The mobile terminal as set forth in claim 24, wherein 
said display controller concurrently displays said 
broadcast data received by said broadcast-data re- 
ceiver and said communication image received by 
said communicator in a display unit. 

26. A method of looking at and listening to broadcast 
between a broadcast-transmitting server and a plu- 
rality of mobile terminals connected to said broad- 
cast-transmitting server through a communication 
network, comprising: 
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said broadcast-transmitting server separating 
one or a plurality of broadcast provided through 
broadcast-distribution service., into broadcast 
image and broadcast data, and transmitting 
said broadcast data to said mobile terminal; 
said mobile terminal receiving said broadcast 
data, and transmitting a request of transmission 
of said broadcast image to said broadcast- 
transmitting server in accordance with said 
broadcast data; and 

said broadcast-transmitting server receiving 
said request from said mobile terminal, and 
transmitting the requested broadcast image to 
said mobile terminal. 

27. A method of looking at and listening to broadcast 
between a broadcast-transmitting server and a plu- 
rality of mobile terminals connected to said broad- 
cast-transmitting server through a communication 
network, comprising: 

said mobile terminal transmitting a request of 
transmission of broadcast data to said broad- 
cast-transmitting server; 

said broadcast-transmitting server receiving 
said request transmitted from said mobile ter- 
minal, separating one or a plurality of broadcast 
provided through broadcast-distribution serv- 
ice, into broadcast image and broadcast data, 
and transmitting said broadcast data to said 
mobile terminal which transmitted said request; 
said mobile terminal receiving said broadcast 
data, and transmitting a request of transmission 
of said broadcast image to said broadcast- 
transmitting server in accordance with said 
broadcast data; and 

said broadcast-transmitting server receiving 
said request from said mobile terminal, and 
transmitting the requested broadcast image to 
said mobile terminal. 

28. A method of looking at and listening to broadcast 
among a broadcast-transmitting server, a plurality 
of mobile terminals, and a control apparatus for 
looking at and listening to broadcast and making 
communication in multi-point which apparatus is 
connected to said broadcast-transmitting server 
and said mobile terminals through a communication 
network, comprising: 

said control apparatus receiving images and 
sound from one or a plurality of mobile terminal 
(s), synthesizing sard images and said sound 
with one another, respectively, to thereby pro- 
duce communication image and communica- 
tion sound, and transmitting the thus produced 
communication image and communication 
sound; 



said mobile terminal receiving said communi- 
cation image and said communication sound, 
displaying said communication image, output- 
ting said communication sound, and transmit- 

5 ting a request of transmission of broadcast data 

to said control apparatus; 
said control apparatus requested said broad- 
cast-transmitting server to transmit thereto said 
broadcast data requested by said mobile termi- 

10 nal; 

said broadcast-transmitting server separating 
one or a plurality of broadcast provided through 
broadcast-distribution service, into broadcast 
image and broadcast data, and transmitting 

15 said requested broadcast data to said control 

apparatus; and 

said control apparatus receiving said broadcast 
data and transmitting the thus received broad- 
cast data to said mobile terminal. 
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29. The method as set forth in claim 28, wherein said 
mobile terminal requests said control apparatus to 
synthesize said broadcast data received by said 
control apparatus, 

said control apparatus synthesizes said broad- 
cast data, said communication image and said 
communication sound with one another, and 
transmits them to said mobile terminal, and 
said mobile terminal receives and outputs said 
communication image and said communication 
sound to which said broadcast data has been 
synthesized. 



35 30. A method of looking at and listening to broadcast 
among a broadcast-transmitting server, a plurality 
of mobile terminals, and a control apparatus for 
looking at and listening to broadcast and making 
communication in multi-point which apparatus is 

40 connected to said broadcast-transmitting server 
and said mobile terminals through a communication 
network, comprising: 



45 



50 



55 



said control apparatus receiving images and 
sound from one or a plurality of mobile terminal 
(s), synthesizing said images and said sound 
with one another, respectively, to thereby pro- 
duce communication image and communica- 
tion sound, and transmitting the thus produced 
communication image and communication 
sound; 

said mobile terminal receiving said communi- 
cation image and said communication sound, 
displaying said communication image, output- 
ting said communication sound, and transmit- 
ting a request of transmission of broadcast im- 
age to said control apparatus; 
said control apparatus requested said broad- 
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cast-transmitting server to transmit thereto said 
broadcast image requested by said mobile ter- 
minal; 

said broadcast-transmitting server separating 
one or a plurality of broadcast provided through 5 
broadcast-distribution service, into broadcast 
image and broadcast data, and transmitting 
said requested broadcast image to said control 
apparatus; and 

said control apparatus receiving said broadcast 10 
image and transmitting the thus received 
broadcast image to said mobile terminal. 

31. The method as set forth in claim 30, wherein said 
mobile terminal requests said control apparatus to is 
synthesize said broadcast image received by said 
control apparatus, 

said control apparatus synthesizes said broad- 
cast image, said communication image and 20 
said communication sound with one another, 
and transmits them to said mobile terminal, and 
said mobile terminal receives and outputs said 
communication image and said communication 
sound to which said broadcast image has been 25 
synthesized. 
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FIG.2 
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